Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky testPostFilterDisablesCountOptimization with concurrent search enabled #11674

Conversation

ticheng-aws
Copy link
Contributor

Description

This flaky test uses RandomIndexWriter to add random number of documents to the search index. As long as the score_count in the concurrent search case matches the non-concurrent search case, we can tune the expected value for min_score/min_score_count to make it less sensitive. I ran the new changes 1000+ times to make sure that they all passed.

Related Issues

Resolves #10139

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions github-actions bot added bug Something isn't working flaky-test Random test failure that succeeds on second run Search Search query, autocomplete ...etc labels Dec 26, 2023
@ticheng-aws ticheng-aws force-pushed the cs-testPostFilterDisablesCountOptimization branch from 4f4626a to 80f6ee1 Compare December 26, 2023 23:16
Copy link
Contributor

github-actions bot commented Dec 26, 2023

Compatibility status:

Checks if related components are compatible with change 5b65415

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/performance-analyzer.git]

Copy link
Contributor

✅ Gradle check result for 4f4626a: SUCCESS

Copy link

codecov bot commented Dec 26, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (bb4602d) 71.36% compared to head (5b65415) 71.39%.
Report is 2 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #11674      +/-   ##
============================================
+ Coverage     71.36%   71.39%   +0.02%     
+ Complexity    59205    59184      -21     
============================================
  Files          4906     4906              
  Lines        278198   278198              
  Branches      40422    40422              
============================================
+ Hits         198537   198617      +80     
+ Misses        63187    63055     -132     
- Partials      16474    16526      +52     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

❕ Gradle check result for 80f6ee1: UNSTABLE

  • TEST FAILURES:
      2 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.classMethod
      1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

@ticheng-aws ticheng-aws force-pushed the cs-testPostFilterDisablesCountOptimization branch from 80f6ee1 to 5b65415 Compare December 27, 2023 00:28
Copy link
Contributor

✅ Gradle check result for 5b65415: SUCCESS

@sohami sohami added the backport 2.x Backport to 2.x branch label Dec 27, 2023
@sohami sohami merged commit 316b60a into opensearch-project:main Dec 27, 2023
33 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Dec 27, 2023
…rch enabled (#11674)

Signed-off-by: Ticheng Lin <[email protected]>
(cherry picked from commit 316b60a)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
sohami pushed a commit that referenced this pull request Dec 28, 2023
…rch enabled (#11674) (#11682)

(cherry picked from commit 316b60a)

Signed-off-by: Ticheng Lin <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
rayshrey pushed a commit to rayshrey/OpenSearch that referenced this pull request Mar 18, 2024
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch bug Something isn't working flaky-test Random test failure that succeeds on second run Search Search query, autocomplete ...etc skip-changelog
Projects
None yet
2 participants